-
Notifications
You must be signed in to change notification settings - Fork 187
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feat/1749 abort load package and raise exception on terminal errors in jobs #1781
Feat/1749 abort load package and raise exception on terminal errors in jobs #1781
Conversation
✅ Deploy Preview for dlt-hub-docs canceled.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How we need to test it
- there are tests in dummy client that are testing abort feature, there just remove the flag. it is by default on
- make the other tests to pass by disabling the flag
look for raise_on_failed_jobs
in the whole code
we use it to raise on load info, those are not needed anymore and can be removed (many of those)
I see that we set this flag in airflow helper. we should change the default there and also we never set it to false
there are other cases. you'll find them for sure
b305d9b
to
932c160
Compare
docs/website/docs/reference/performance_snippets/performance-snippets.py
Show resolved
Hide resolved
…il_task_if_any_job_failed
…and calls to raise_on_failed_jobs()
b891bc1
to
2606217
Compare
…e. Refactors tests where necessary.
e851b84
to
864f642
Compare
…ption-on-terminal-errors-in-jobs
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
docs/website/docs/reference/performance_snippets/performance-snippets.py
Show resolved
Hide resolved
83b9b15
to
aa66a49
Compare
aa66a49
to
74697d8
Compare
Description
Related Issues